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ABSTRACT 


A  semi-Mar kovian  point  process  Is  defined,  for  which  the  intervals 
of  time  between  successive  events  have  phase  type  distribution.  The 
distribution  of  the  number  of  events  In  an  interval  is  examined,  and  it  is 
shown  how  the  expected  number  of  events  in  an  interval  may  be  efficiently 
computed.  A  stationary  version  of  the  process  is  analysed.  In  parti¬ 
cular,  the  necessary  and  sufficient  condition  under  which  the  new  process 
is  a  renewal  process  is  determined.  Simple  sufficient  conditions  are 
presented. 
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Introduction 

Most  of  the  literature  on  queueing  theory  deals  with  systems  for 
which  arrivals  occur  according  to  a  renewal  process.  From  the  available 
results,  it  is  clear  that  the  analysis  of  a  queueing  system  with  a  general 
non-renewal  arrival  process  is  very  difficult. 

In  the  present  paper,  we  define  and  discuss  a  special  semi-Mar kovian 
point  process.  It  is  assumed  that  there  are  N  different  types  of  inter¬ 
vals,  each  with  a  phase  type  distribution.  The  types  of  successive  intervals 
are  determined  by  a  Markov  chain  with  transition  probability  matrix  P. 

If  a  given  interval  is  of  type  i,  1  <  i  <_N,  then  the  following  interval 
is  of  type  j,  1  <  ]  <  S,  with  probability  P^.  Phase  type  distributions 
have  great  versatility  and  the  structure  of  the  process  is  very  simple. 

It  should,  therefore,  be  a  useful  tool  in  modeling  queueing  systems  with 
non-independent  arrivals,  and  provide  analytically  or  algorithmically 
tractable  results. 

He  shall  give  a  formal  definition  of  the  process  in  the  next  section. 

We  examine  in  Section  2  the  number  of  events  in  an  interval  and  show  how  the 
expected  number  of  events  may  be  efficiently  computed.  In  Section  3,  we 
analyse  the  correlation  structure  of  a  stationary  version  of  the  process. 

In  particular,  we  determine  the  necessary  and  sufficient  condition  under  which 
that  process  is  a  renewal  process.  In  Section  4,  some  examples  such  as 
the  Interrupted  Poisson  arrivals  are  considered  in  further  detail. 

Notational  convention.  All  vectors  are  represented  by  underlined 
letters.  The  context  Indicates  whether  they  are  row  or  column  vectors. 

In  order  to  facilitate  the  reading  of  the  formulas,  the  expression  v  w 
always  represents  the  inner  product  of  a  row  vector  v  by  a  column  vector 
w;  the  expression  w  •  v  always  represents  the  product  of  a  column  vector 
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w  by  a  row  vector  v,  yielding  a  matrix  whose  (i,j)th  element  is 

W  V  . 

1 j 

1.  The  Phase  Type  Semi-Markov lan  Point  Process 
1.1  Phase  Type  Distributions 

Phase  type  distributions  have  been  introduced  by  Neuts  [4].  Con¬ 
sider  a  (n+l)-state  continuous-parameter  Markov  process,  with  n  transient 
states  and  one  absorbing  state.  Its  infinitesimal  generator  Q  is  of  the 
form 

_  (t  t°1 

0  0  j 

where  T  is  a  square  matrix  of  order  n,  with  T^  <  0,  T^  0,  for 
i  1*  j,  and  such  that  T  1  exists.  The  n-vector  T“  has  nonnegative 
entries,  and  is  equal  to  -T«s .  the  vector  e  has  all  entries  equal  to  one. 
The  vector  of  Initial  probabilities  is  denoted  by  (a,an+i),  and  satisfies 
a  e  +  a  ■  1,  0  <  a  . ,  <1. 

The  probability  distribution  F(*)  of  the  tine  till  absorption  in  the 
state  n+1  is  then  given  by 

F(x)  ■  1  -  a  exp(Tx)  e  ,  for  x  ^  0  . 

The  probability  distribution  F(«)  is  said  to  be  of  phase  type  (in  short, 

"F  is  PH").  The  pair  (a,T)  is  called  a  representation  of  F(*).  In 

this  paper,  we  assume  that  •  0,  so  that  F(«)  does  not  have  a  jump 

at  0.  Furthermore,  we  assume  that  the  representation  is  such  that  each 
state  has  a  positive  probability  of  being  visited  before  absorption.  Under 
that  assumption,  the  Markov  chain  with  generator  T  +  T*  •  is  irreducible. 
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(k) 

The  moments  u  of  F(*)  about  the  origin  all  exist  and  are  given 


by 


y<k>  -  (-l)k  k!  a  T_k  e  ,  for  k  >.  1 


(1) 


1.2  The  Point  Process 

We  consider  N  PH-distributions ,  with  representations  (o^.T^),  where 
T^  is  a  square  matrix  of  order  n^,  for  i  *  1,  N,  and  an  N-state 

Irreducible  Markov  chain  with  transition  matrix  P.  If  the  Markov  chain 
has  made  a  transition  to  the  state  i,  the  next  transition  is  to  the  state 
j,  with  probability  p^,  and  the  time  between  these  transitions  has  a  PH- 
distribution  F^?),  with  representation  (o^.T^,  independent  of  j.  The 
epochs  of  transitions  for  the  Markov  chain  correspond  to  the  epochs  of,  events 
for  the  point  process. 

We  denote  respectively  by  N(t),  C(t)  and  4(t),  the  number  of  events 
in  (0,t],  the  state  of  the  Markov  chain  P  at  time  t,  and  the  state 
of  the  Markov  chain  TC(t)»  at  time  t.  In  other  words,  suppose  that  the 
last  event  before  t  occurred  at  time  t.  At  time  x,  the  Markov  chain  P 
made  a  transition  to  the  state  C(x)  -  j,  say,  and  an  Initial  state  was 
chosen  for  the  Markov  chain  T^ ,  according  to  the  probability  vector  . 

In  the  interval  (x,t],  the  Markov  chain  underwent  zero,  one  or  more 

than  one  transitions,  without  entering  its  absorbing  state.  At  time  t, 

C(t)  ■  j,  and  the  Markov  chain  Tj  is  in  the  state  $(t). 

We  make  the  following  independence  assumption.  For  every  t  >  0,  the 
intervals  of  time  between  events  are  conditionally  Independent,  given  the 
path  function  of  the  Markov  chain  P.  It  is  then  clear  that  the  process 
{N(t),  C(t),  9(t),  t  >_  0 }  is  a  Markov  process  with  state  space 


■  ; 
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v  ^  0,  1  £  j  <  N,  In  order  to  diatinguish  easily 
between  the  Markov  chain  P  and  the  Markov  chains  T^,  i  ■  1,  ....  N,  we 
shall  refer  to  the  states  of  any  Markov  chain  as  "phases”. 


2.  The  Number  of  Events  in  an  Interval 

We  define  the  probabilities  S.  _  .  -  P[N(t)  ■  v,  C(t)  *  j,  4(t)  ■  4>  | 

1*4  »j  *4 

C(0)  ■  i,  4(0)  »  5l»  and  order  the  elements  ((j,$);  1  <_  j  <_N,  1  <  ♦  <  n  } 

J 

as  follows 2  (1 , 1) ,  (1*2),  . .  • ,  (l,n^),(2,l),  . . • *  (2 ^2 ) »  •••*  (N» 1) *  . . . * 
(N,^).  Finally  we  define  the  block-partitioned  square  matrix  S(v,t)  of 
order  n^  +  n^  +  . . .  +  n^  by 


S1>N(v,t) 


i,i(v,c) 

S1>2(v,t) 

S2i2(.,c) 

S(v,t) 


lSM,l(v,t)  SN,2(v,t) 


S2,N(',,t) 


•'  SN,N(V,t)J 


where  the  blocks  S,  . (v,t)  have  n,  rows  and  n,  columns,  and  the 
*»  J  1  J 

(£,4)th  element  of  S.  ,(v,t)  is  equal  to  S.  .  ,(v,t). 

i.j  i»4*J»4 

The  Chapman-Kolmogorov  equations  for  the  process  (N(t),  C(t),  4(t),  t  ^  0} 
may  be  written  in  matrix  notation  as 


s;tJ(o,t)  -  0  , 


for  i  ^  j  , 


Si,;j 


■  ^(0,t)  Ti,  for  i  -  j  , 

sifj(v,t)  Tj  -  ^  S1>k(v-l,t)  Pkj  *  SLj  * 

for  v  >  1  . 


Therefore,  the  matrices  S(v,t)  satisfy  the  system  of  linear  differential 
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equations: 

S' (0,t)  -  S(0,t)  T  , 

S’  (v,t)  ■  S(v,t)  T  -  S(v-l,t)  T  A  ,  for  \>  >_  1  , 

with  initial  conditions  S(0,0)  -  I,  S(vf0)  ■  0,  for  v  >_  1,  where  the 
square  matrices  T  and  A  are  of  order  ni  +  n2  +  * • •  +  ^  •  The  matrix 
T  is  block-diagonal  and  given  by 


0  0  0 


and  the  block-partitioned  matrix  A  is 

given  by 

’PllV% 

P12— 1  —2 

•••  pinV% 

A  - 

p21— 2  -1 

• 

• 

P22*2**2 

• 

• 

• 

•  •  *  p2NS-2  ’% 

• 

• 

• 

[phA*% 

PN2% -2 

By  e^  we  denote  an  n^-vector  with  each  entry  equal  to  one. 

00 

The  matrix-generating  function  &(z,t)  ■  £  zv  S(v,t),  defined  for 

v-0 

| z |  <_  1,  satisfies  the  differential  equation 

-r|-  ^(z,t)  ■  !>(z,t)  T  (I-zA)  ,  2»(z,0)  *  I,  for  t  >_  0  . 

<7  t 

Hence,  we  have  that  S(z,t)  ■  exp  [T(I-zA)t].  In  particular,  &(0,t)  * 
exp(Tt),  as  is  to  be  expected.  Also,  Sf(l,t)  ■  exp  [T(I-A)t],  which  is 


•  il 


6 


again  obvious,  since  Che  process  (C(t),  4(t),  t  X  0}  Is  a  conclnuous  para¬ 
meter  Markov  chain  with  Infinitesimal  generator  T(I-A). 

We  now  define  the  matrix  M(t)  ■  £(z,t^t-^»  and  the  vector 

m(t)  ■  M(t>£.  We  partition  that  vector  as  m(t)  »  (rn^(t)  .m^Ct)  ,. . . 
where  m^(t),  i  -  has  n^  components.  The  component  m^  ^ (t) 

is  the  expected  number  of  events  occurring  before  time  t,  given  the  initial 
conditions  C(0)  »  i,  and  4(0)  *  £.  Furthermore,  we  denote  by  x  the  in¬ 
variant  probability  vector  associated  with  P,  i.e.  x  P  “  X»  X  ®.  m 
Every  entry  of  x  strictly  positive.  Finally,  we  denote  by  x  the 
stationary  probability  vector  of  T(I-A),  i.e.  jt  T(I-A)  ■  0,  it  e_  «  1. 

Leans  1. 


The  vector  m(t)  is  given  by 


m(t)  -  m*t  e  -  (I-n)  ( t^-TCl-A)]"1  T  e 


-  [Il-exp (T(I-A)  t)  ]  [x^-Td-A)]’1  T  e  ,  for  t  >  0  , 


where  the  square  matrix  n  of  order  n^  +  n^  +  . . .  +  nN  is  equal  to 

e  •  ir.  t*  is  any  real  number  such  that  t*  >  max  {-(T(I-A)).  ,  , ; 

—  —  —  i,4;i,4 

l<^i<_N,  1  X  $  X  ^  »  and  m*  is  given  by 

■  -f  T  e  .  (2 

Moreover,  if  we  partition  it  as  x  "  2* '  *  *  »•%)  *  w*iere  18  an 

^-vector,  i  ■  1,  ....  N,  we  have  that 


X^  *  c  A  ,  for  i  ■  1,  ....  N 


The  normalizing  constant  c  satisfies 


m*  •  c  ■  (x  )  * 


(5) 


where  the  N-vector  has  components  T  ^  e. 

Proof .  To  prove  the  first  part  of  the  lemma,  we  observe  that  the  point  process 
under  consideration  is  a  special  case  of  the  "Versatile  Markovian  Point  Process" 
defined  in  Neuts  [5].  Equation  (2)  then  follows  by  adapting  Equation  (12) 
of  [5]  to  our  process.  The  proof  of  the  second  part  is  immediate. 

Remarks 

1.  The  third  term  in  (2)  tends  to  zero  as  t  tends  to  infinity,  since 
n-exp[T(I-A)t]  ■  II  -  exp  [§(l,t)],  does.  Therefore  the  first  two  terms 
give  the  linear  asymptote  of  m(t) . 

2.  In  order  to  compute  m(t),  it  is  not  necessary  to  evaluate  the  inverse 
of  the  large  matrix  [ x*n-T(I-A) ] .  It  suffices  to  determine  the  vector  u^ 
defined  as 

u  -  -  (t*n  -  T(I-A)]-1  T  e  .  (6) 

This  may  be  done  efficiently  as  we  show  below. 

3.  The  main  problem  in  computing  m(t)  from  (2)  therefore  lies  in  eval¬ 

uating  the  third  term,  which  we  denote  by  v(t).  The  vector  v(t)  is  the 
solution  of  the  system  of  differential  equations,  of  order  ^  +  ... 

+  n^,  given  by 

v' (t)  *  T(I-A)  v(t)  ,  v(0)  -  (n-I)  u  . 

Lemma  2 

If  we  partition  the  vector  vi  as  u  -  (u^.u^.,.  ..,u^),  where 
is  an  n^-vector  for  i  ■  1,  ..., 


N,  then 


where  v  -  -m*  (I-P+r)-1  P  y.(1)  , 

v  *  m*/x*  +  y  m*^  X  -  h  v.  • 

(2)  (2) 

The  vectors  jj  and  h  have  N  components,  given  by  y^  » 

-2  (1) 

2  o.  T.  e,  h.  ■  m*  v.  g,  ,  for  i  *  1,  ....  N. 

*“1  I  -  1  1  1 

Proof.  The  vector  ii  is  the  unique  solution  to  the  system 

[x*n  -  T(I-A)]  u  -  -  T  e  .  (8) 


Upon  substitution  of  the  stated  expressions  for  ti  and  after  some  routine, 
but  belabored  calculations,  it  is  verified  that  (7)  indeed  provides  the  solu¬ 
tion  to  (8).  The  details  are  omitted  for  the  sake  of  brevity. 

The  equation  (2)  now  becomes 


m(t)  =■  m*te  +  m*(I-II)  (T^-tOe  +  m*[n-exp(T(I-A)t)  ]  (T_1-N)e  , 


for  t  >  0 


(9) 


where  the  matrix  N  is  block-diagonal  and  given  by 


'1 

0 


is  a  square  matrix  of  order  n^,  and  is  equal  to  [(I-P+r)  1  P  I. 


Remark. 


In  order  to  determine  (T  -N)e^  it  is  not  necessary  to  invert  matrices. 
One  merely  solves  N+l  systems  of  linear  equations,  i.e.  the  systems 


r.  x,  ■  e,  for  i  •  1, 
1  — 1  — 


(1) 


N,  and  the  system  (I-P+Dx  ■  P  jj. 
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.  A  Stationary  Version  of  the  Point  Process 

Usually,  the  stationary  point  process,  which  we  denote  by  P*,  is  ob¬ 
tained  by  choosing  the  initial  state  (C(0),|6(0))  according  to  the  proba- 
bility  vector  jt..  We  consider  a  slightly  different  process,  denoted  by  P, 
for  which  (C(0),$(0))  is  chosen  by  P[C(Q)  *  j,*(0)  *  £]  -  In 

other  words,  we  choose  the  time  origin  so  that  at  time  0-,  an  event  has  occured, 
the  type  of  the  next  interval  is  chosen  according  to  the  stationary  vector  x 
of  P.  In  view  of  our  ultimate  objective  of  using  this  process  to  model 
arrivals  to  queueing  systems,  the  process  $  has  the  following  interesting 
property. 

Let  us  denote  by  X  the  interval  of  time  between  the  (n-l)st  and  the 
n 

nth  event  (between  time  0  and  the  first  event,  if  n  *  1). 

Lemma  3 

The  random  variables  {X  ,n>l}  have  a  common  marginal  distribution 

n  — 

r(*).  The  distribution  r(«)  is  PH,  and  has  a  representation  (a,T),  where 
the  vector  £  has  n^  +  +  • . .  components  and  is  given  by  a  ■ 

^Y1-1,Y2^2’’  *•  »ynSV*  Th«efore 

N 

r(x)  ■  1  -  Z  y.  a.  exp(T.x)  e  ,  for  x  >  0  , 

i-1  t_1  1  " 

and  the  kth  moment  m^  0f  r(0  about  the  origin  is  equal  to 


for  k  >  1  . 


The  N-vectors  have  entries  ■  (-1)^  k!  T^  £  . 

Proof .  The  proof  is  obvious. 

In  the  remainder  of  this  section,  we  examine  the  correlation  structure 
of  the  intervals  of  time  between  events.  This  is  related  to  recent  work  by 
Simon  [7].  Because  of  the  difference  in  our  approach,  we  postpone  discussion 
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of  this  relation  to  the  end  of  this  section. 


We  now  introduce  the  notion  of  linear  dependence  for  PH-distributions. 
Definition  1 

The  set  {(£.  ,T. ) ,  1  <,  i  N>  is  a  set  of  linearly  independent  PH- 
_1  1  N 

distributions  if  and  only  if  Z  d.F  (x)  »  0,  for  all  x  1  0,  implies 

i-1  1 

that  d^  is  equal  to  zero,  for  i  ■  1,  ...»  N,  where  F^x)  *  1  - 
expCTjXte  ,  for  x  l  0  . 

Definition  2 

The  PH-distribution  (J3,B)  is  linearly  dependent  of  the  PH-distributions 


(o.,T.),  i  ■  1,  ...»  N,  if  and  only  if  there  exist  {d1 ,  d  ,  . 

N  L 

that  d  4  0  for  some  i,  and  1  -  £  exp(Bx)  £  *  Z  d.F.  (x), 

i=l  1  1 

where  the  F^(x)  are  defined  above. 

It  is  clear  that  for  any  such  set  {d^,  ...,  d^}  we  have 
Remarks 


. ,  d„),  such 
N 

for  all  x  1  0, 


1.  The  term  "linearly  independent"  has  been  chosen  for  the  following  reason. 

N 

We  easily  observe  that  Z  d.  F.  (x)  is  equal  to  zero  for  all  positive  x 
N  i-1  1  1 

if  and  only  if  Z  d.  T*  e_  is  equal  to  zero  for  all  k  >_  1.  The  defini- 
i*l  1—1  1 

tion  1  Is  therefore  equivalent  to  the  condition  that  the  infinite  vectors 
2 

(^T^OjT^e, . . . )  ,  i  ■  1,  ...»  N,  are  linearly  independent. 

2.  If  (j5,B)  is  linearly  dependent  of  i  ■  1,  . ..,  N}  ,  and 

d^  10,  for  all  i  ■  1,  ...,  N,  then  (_B , B)  and  (8q,Bq)  are  two  repre¬ 
sentations  of  the  same  PH-distribution,  where 


(dl-l’d2-2,,,,,dNaN)  ’ 


and 
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The  proof  Is  elementary.  Similarly,  if  d^  <  0,  for  i  »  1,  J,  and 

d^  >_  0,  for  i  ■  J  +  1,  N,  then  clearly 


J  N 

i  +  r  Id  |  -Ed. 

i-1  i-J+1  1 

f\, 

If  we  set  the  latter  quantity  equal  to  d,  then  and  (§.2»B2^ 

where 


are  two  representations  of  the  same  PH-distribution. 
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Let  now  the  PH-distributions  { (o^,T^) ,  i  *  1 . N)  which  define 

the  point  process,  be  expressed  as  linear  combinations  of  the  linearly 
independent  PH-distributions  ^(£j»Zj)»  j  “  1  L>,  with  L  £  N,  i.e. 


F.(x)  -  Z  d.,  G  (x)  , 

j-1  2  2 


for  all  x  >_  0,  and  i  ■  1,  ...»  N, 


where  G^  (x)  *  1  -  exp(ZjX>£.  We  denote  by  D  the  matrix  with  (i,j)th 

>, 

), 


element  equal  to  d^j  .  We  also  define  the  vectors  F(x)  -  (F^(x) ,F2 (x) , . . . , 
Fn(x)),  G(x)  -  (G1(x),G2(x),...,Gl(x)),  and  u*(k)  -  (y*(k) . u*(k) 


for  k  >_  1,  where  u* 


(k) 


is  the  kth  moment  about  the  origin  of  G^C*)* 


We  then  clearly  have  that 


F(x)  -  D  G(x)  , 

for  x  ^  0  , 

(10) 

(k)  _  .(k) 

JI  ■  D  £  *  , 

for  k  >_  1  . 

(ID 

It  is  also  clear  that  D  e«  e  . 

We  emphasize  that  the  set  of  PH-distributions  ((Cj»Zj)»j  ■  1,  . L) 
is  not  necessarily  a  subset  of  {(a^,Tj),i  ■  1,  ...»  N).  The  following  is  an 
illustrative  example. 

If 


(-l,Tl> 


Co 2 


(—3*^3^ 


-  (1/2, 1/2), 

r 

‘  (2/3, 1/3), 

' 

*  (1/3, 2/3), 


-X 


9 


9 


<vV  ■ 

(1/3, 1/3, 1/3), 

0 

1 

0 

0 

. 

0 

j 

Chen  we  may  either  choose 


.Zj)  -  (fiSj.I 

y  • 

i  - 

with 

'  i 

0 

0  ' 

0 

l 

0 

D  - 

0 

0 

1 

. 

2/5 

1/5 

2/5 

or  alcernacively 

(Vzj 

)  -  ((1) 

,(-x 

i»  • 

j  ■ 

in  which 

case  D  is  given  by 

1/2 

1/2 

0  ' 

2/3 

0 

1/3 

D  - 

0 

1/3 

2/3 

1/3 

1/3 

1/3, 

Lemma  4 

The 

covariance  between 

X 

and  X_, 

,  f 

n 

min 

by 

Cov 

(xn,x)  - 

n  crnn 

e(1>  id) 

(P“- 

J  -  1.  2,  3, 


(12) 


and  also  by 


Cov  aB,W  -  DT  &(*)  (Pa-D  0  ii*a)  , 


(13) 
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where  for  any  vector  £,  the  matrix  A(x)  is  defined  by  diag  (x^ . x^) 

Proof.  By  Lemma  3,  the  covariance  is  equal  to 


Cov  (X  .X  ) 
n  n  t  tn 


E(X  ,X  )  -  E(X  )  E(X ) 
u  uTtn  ti  ntn 


which  proves  (12).  Equation  (13)  results  from  (11). 

From  Lemmas  3  and  4,  ve  conclude  that,  for  the  process  the  intervals 

of  time  between  events  are  identically  distributed  and  are  in  general  cor¬ 
related.  If  the  Markov  chain  P  is  aperiodic,  then  11m  Pm  -  T,  and  the 

covariance  of  X  and  X  ,  tends  to  zero  as  m  tends  to  infinity, 
n  mm 

To  conclude  this  section,  we  shall  now  examine  under  what  condition 
the  process  P  is  a  renewal  process.  If  $  is  a  renewal  process,  then  it  is 
characterised  by  its  interrenewal  distribution  r (•) -  The  distribution 
r(-)  is  PH  and  is  represented  as  r(x)  “X  ■£(*)*  f°r  x  (by  Lemma  3) 

or  as  r(x)  -  xD  £(x)  *  for  *  i  0*  where  (G^x) , .. .  ,GL(x))  is  any  set  of 
linearly  independent  PH-distributions  satisfying  (10) ,  and  D  is  the  cor¬ 
responding  matrix.  The  next  theorem  holds  for  any  choice  of  £(x). 

Theorem  1 

The  process  $  is  a  renewal  process  if  and  only  if  the  following  pro¬ 


perty  holds. 

For  all  k  >_  2,  and  for  all  (t^,...,t^)  satisfying  1  <  tj  <  L, 
for  1  *  1,  ...,  k. 


or  equivalently. 


X  4  n  [(P-r)A  ]  e  -  0 

T1  i-2  Ti 


k  k 

x  A  (  n  P  A  )  e  •  H  (x  D._  ) 
T1  i-2  Ti  ~  i-1  ■  Ti 


(15) 


where  represents  the  jth  column  of  the  matrix  D,  and  A^  «  diag  (D_(  , ) . 

Proof .  The  proof  is  very  simple.  Since  the  variables  ,n  >_  0}  are  identi- 

cally  distributed,  P  is  a  renewal  process  if  and  only  if  for  all  k  >_  2, 

the  random  variables  X^ ,  X, . X^  are  independent,  which  is  true  if  and 

only  if 


P[  n  {X  lx  }]  -  n  P[X.  <x  1, 
i-1  i-0  1  1 


for  all  x^,  ...»  x^  0  , 


equiva len  tly ,  if 

N  k  k 

i  iy  f  (x  )  n  p  f  (x  )  -  n  yv  f  (x  )}  »  o  , 

V1  1  1  Vi J  i  3  3*1  i  i 

l<i<k 


for  all  x^,  . ..,  x^  >.0  ,  if  and  only  if  (by  (10)) 


N  L  k 

I  E  (y  d  [  n  (P  -Y  )d  ] 

V1  v1  Vi  ViTi  j"2  Vj"lVj  Vj  VjTj 


1  <  i  <  k 


•  II  G  (x. )}  *  0  ,  for  all  x. ,  ...,  x.  >_  0 

J-l  Tj  2 


Since  the  PH-distributions  G^*)  are  linearly  independent,  this  holds  if 
and  only  if 


E  (Y  d  [  n  (P  -Y  )d  ]}  -  0  , 

yl  Vi  j-2  Vj-lVj  vj  Vi 

l<i<k 


for  all  such  that  1  <_ <_ L.  The  condition  (14)  is  now 

obvious,  and  it  is  a  simple  matter  to  prove  that  (14)  and  (15)  are  equivalent. 
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This  theorem  provides  us  with  a  technical  condition  which  is  not  very 
attractive.  The  following  corollary  is  more  interesting  and  useful  for 
modeling  purposes. 

Corollary  1 

For  $  to  be  a  renewal  process,  it  is  sufficient  that 

(P-D  D  -  0  ,  (16) 

or  that 

DTA(x>  (P-D  -  0  .  (17) 

If  L  is  equal  to  one,  then  both  conditions  are  always  satisfied  and  P 
is  always  a  renewal  process. 

If  L  is  equal  to  N,  then  both  couditions  are  necessary,  as  ?  is  a 
renewal  process  if  and  only  if  the  matrix  P-T  is  equal  to  zero. 

Proof.  The  condition  (16)  is  obviously  sufficient,  as  (P-r)D#i  ■  £  for 

all  i  implies  that  (Pn-T)  A±  e  -  Pn_1(P-r)  D#1  -  0  for  each  n  >_  1  and 

each  i  -  1,  . . . ,  L,  which  in  turn  implies  (14) . 

Similarly,  the  condition  (17)  is  sufficient,  since 

X  A1(Pn-D  -  x  A1(P-DPn"1  -  j£t  A(x)  (P-r)Pn_1  . 

If  L  is  equal  to  one,  then  D  ■  .e  and  both  conditions  (16)  and  (17) 
are  satisfied. 

If  L  is  equal  to  H,  then  D  may  be  chosen  equal  to  I,  and  both 
(16)  and  (17)  reduce  to  P-r  ■  0.  The  necessary  part  of  the  condition  re¬ 
sults  from  (14):  if  k  -  1  ,  then  x  A^P-r)  A^e.  must  be  equal 
to  zero  for  all  i,  J  -  1,  ...»  S.  As  D  •  I,  this  reduces  to  Y^CP^-Yj)  * 

0,  for  all  i,  j  ■  1,  . ..,  N.  Since  y^  >  0  for  all  1,  the  Corollary  is 

proved. 


.. .  Kata as 


Remarks 


1.  One  easily  proves  that  condition  (16)  holds  if  and  only  if  there  exist 
a  vector  v  such  that  P  D  •  e  •  v,  Therefore,  it  is  not  necessary  to 
determine  x  in  order  to  check  whether  (16)  holds  or  not. 

2.  The  conditions  (16)  and  (17)  are  not  equivalent.  Simple  examples  exist, 
for  which  one  of  the  conditions  holds,  but  not  the  other. 

3.  If  neither  (16)  nor  (17)  holds,  the  combined  condition, 

DT  A(x)  (P-T)  D  -  0  ,  (18) 

is  not  a  sufficient  condition  for  £*  to  be  a  renewal  process  (this  is 
proved  by  a  counterexample),  but  is  the  necessary  and  sufficient  condition 
for  two  successive  intervals  of  time  to  be  Independent. 

Simon  [7]  examines  equivalences  for  Markov-renewal  processes  and,  in 
particular,  the  conditions  under  which  a  Markov-renewal  process  is  equiva- 
lent  to  a  renewal  process.  It  appears  that  for  our  process  P,  Theorems 
2.2.1,  2.2.2  and  2.2.9  [7]  respectively  correspond  to  the  sufficient  condi¬ 
tion  (17),  and  to  the  cases  L  ■  1  and  L  »  N  in  Corollary  1.  From 
Theorem  2.2.8  [7],  results  the  following  necessary  condition.  There  exist 
a  non-negative  vector  w  such  that 

D^(A(w)  P  -  *  w)  “  0  * 

moreover,  if  condition  (17)  holds,  that  vector  clearly  is  X!  if  condition 
(16)  holds,  we  do  not  Imow  w,  but  the  right  eigenvector  corresponding  to 
r(t)  (in  the  terminology  of  [7]),  is  F(t). 

Because  of  the  special  structure  of  our  point  process,  and  In  particular 
because  the  distributions,  we  consider,  are  PH,  we  have  obtained  conditions 


which  do  not  have  to  be  examined  for  each  t 
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Finally,  let  us  mention  that  Simon  [7]  introduces  and  analyses  the 
notion  of  collapsibility,  which  generalizes  to  Harkov  renewal  processes  the 
notion  of  lumpabllity  for  Markov  chains  -  see  Kemeny  and  Snell  [2].  If 
the  matrix  D  contains  only  entries  equal  to  zero  or  one,  this  corresponds 
to  the  notion  of  collapsibility.  As  we  have  observed,  the  entries  of  D 
may  take  any  real  values.  If  those  values  were  all  positive,  one  might  con¬ 
sider  that  D  corresponds  to  some  sort  of  randomized  collapsibility,  since 
the  row  sums  of  0  are  equal  to  one.  This  correspondence  appears  difficult 
to  extend  to  the  case  where  0  contains  negative  entries. 

4.  Examples 

4.1  Exponential  distributions 

'  The  case  where  the  PH-distributions  (ot^.T^)  are  exponential, 
respectively  with  parameter  X^,  is  particularly  simple.  We  then  Immediately 
obtain  that 


T  -  -MX)  ,  A  -  P  ,  m*  -  (x  A-1)"1  , 

ir^  ■  m*  x^1  ,  for  i  ■  1,  ...»  N  , 

where  the  vectors  X.  and  xf1  respectively  have  components  equal  to  x ^ 
and  X^1.  After  some  simple  manipulations,  (9)  reduces  to 


m(t)  -  a*t  e  +  m*  (I  -  m*r  MX."1))  (I  -  P  +  r)"1  X."1 

+  m*  [m*r  MX."1)  -  exp  (-Mi)  (I-P)t)]  (I  -  P  +  r)"1  I*1  . 


(19) 


Exponential  distributions  with  different  parameters  are  linearly  inde¬ 
pendent.  Therefore,  the  distributions  ((ij*Zj),  1  <_  j  <_  L}  may  be  chosen  to 

l 

be  the  set  of  different  exponential  distributions  in  {(^,1^),  i  -  1,  ....  N} , 
and  the  matrix  D  has  a  very  simple  structure:  each  element  of  D  is  either 
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equal  Co  zero  or  one,  each  row  of  D  contains  exactly  one  element  equal  to 
one,  each  column  of  D  contains  at  least  one  element  equal  to  one.  We 
may  then  strengthen  Corollary  1. 

Corollary  1*. 

If  the  entries  of  D  are  each  equal  to  zero  or  one,  and  if  L  *  N  -  1, 
then  a  necessary  and  sufficient  condition  for  ?  to  be  a  renewal  process  is 
that  one  at  least  of  Equations  (16)  or  (17)  holds. 

Proof.  The  technical  proof  is  belabored.  We  do  reproduce  it  here  since  it 
cannot  be  extended  to  L  <_  N  -  2. 

If  the  matrix  P  has  identical  rows,  then  P  is  obviously  a  renewal 
process,  with  hyperexponential  intervals  between  events,  and  the  matrix 
(I-F+r)-1  in  (9)  may  be  replaced  by  the  identity  matrix. 

4.2  Platooned  events 

Let  us  assume  that  the  process  consists  of  groups  of  events,  the  number 
of  events  in  a  group  has  a  discrete  PH-distribution  (f_,F),  the  intervals  of 
time  between  events  in  a  given  group  have  PH-distribution  (o,A) ,  while  the 
Intervals  of  times  between  groups  have  a  PH-distribution  (j3,B) .  Such  a 
process  may  be  used  to  model  platooned  arrivals  to  a  system,  as  is  done  in 
Neuts  and  Chakravarthy  [6].  Then, 


P  - 


'  F  |  e-Fe  ' 
f F  |  1-fFe 


(20) 


P  is  a  square  matrix  of  order  N  if  F  is  a  matrix  of  order  N  -  1; 
(a^Tf)  -  (a,A),  for  i  -  1,  ...»  N  -  1,  and  (a^.T^)  •  (j3,B). 

Simple  calculations  yield  that  the  stationary  probability  vector  x 
of  P  is  given  by  x  *  (i.*^)  *  where 


20 


X-vF,  Yn  »  1  -  I  e  , 
v  -  (f_(I-F)-1e)_1  f_(I-F)_1  , 

and  that 

m*  -  [(x  e)  (-a  A-1  e)  +  (-_B  B-1  e)]"1  , 

<\,  -1 

*  -m*  y  a  A  ,  for  i  »  1,  . . . ,  N  -  1  , 

■  -m*  y„  3  B  ^  ,  for  i  *  N  . 

The  expression  (9)  does  not  simplify  much. 

If  the  PH-distributions  (a, A)  and  (j3,B)  are  different, 
clearly  may  choose  D  equal  to 

1  O' 

1  0 

D  -  :  : 

•  • 

1  0 

.0  1 

and  we  may  complete  the  corollary  1  as  follows. 

Corollary  1" 

a* 

If  the  matrix  D  is  given  by  (23),  then  the  process  P  is 
process  if  and  only  if 

TD  A(x)  (Pa-r)  D  »  0  ,  for  all  n  X  1  . 


(21) 

(22) 


then  we 

(23) 


a  renewal 

(24) 


Proof.  We  partition  the  matrix  P  and  the  vector  x  as 


Simple  calculations  yield  that 

%  “  ^2  —21  ^I_P11^  »  ^2  “  Cl  +  £2i  S) 

a.  (24)  Is  a  necessary  condition.  This  is  easily  proved  as  follows.  For 

n  ■  1,  it  is  equivalent  to  (18) ,  the  condition  for  two  successive  intervals 
to  be  independent.  For  n  ■  2  ,  we  consider  (14)  with  k  *  3.  Since 
X  AT  (P-r)  A.  (P-r)  At  e  +  X  At  (P-r)  a,  (P-r)  A  e  - 

T  -L  T  T-  im  T/j 

2^1  J 

X  A  (P-D  A  e_  must  be  equal  to  zero,  this  proves  (24)  for  n  =  2. 

T1  3 

Similarly,  we  prove  Chat  (24)  is  necessary  for  larger  values  of  n  . 

b.  (24)  is  a  sufficient  condition.  It  is  easy,  although  tiresome,  to  show 
that  (24)  implies  that 

Xl  C°+1e  -  (P21-xL)  c"  e  -  0  ,  for  all  n  >_  0  ,  (25) 

where  ■  P^  -  e_  •  x^*  This  in  turn  implies  that 


fl 

0 

U, 

1 

c;  -  V  cf1-v  ] 

v«i  I 

•f  - 

■<?* 

^r1  i 

0 

It  is  then  a  simple  matter  to  prove  that  for  v  equal  either  to  1  or  2  , 

(p-r)n  a2  (p-r)m  av  e  -  o  , 

and  (P-r)n  A.^  (P-r)m  Ay  e_  »  (P-r)n+m  dy  e  ,  for  n,m  >_  1  . 

Therefore,  the  left-hand  side  of  (14)  is  equal  to  zero  if  ■  2  for  any 
i  ■  2,  . . . ,  k  -  1  and  is  otherwise  equal  to 

(TD  4(X)  (P-r)1*"1  D)  , 

Tl,7k 


This  completes  the  proof 
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Remark.  This  corollary  has  Che  following  simple  interpretation.  If  D  is 
given  by  (23),  then  N  -  1  of  the  distributions  {(a^>T^),  i  *  1,  ...,  N) 
have  a  "conmon"  type,  the  last  one  has  an  "odd"  type.  Let  denote  the 

number  of  intervals  of  the  conmon  type  between  two  consecutive  intervals  of 
the  odd  type,  and  let  similarly  denote  the  number  of  intervals  of  the  odd 

type  between  two  intervals  of  the  common  type.  From  Corollary  1",  it  results 
that 

the  process  P  is  a  renewal  process  if  and  only  if  and  N2 

both  have  a  geometric  distribution,  the  parameters  being  respective¬ 
ly  equal  to  (1-P22)  and  P22- 

Clearly,  N2  has  a  geometric  distribution  with  parameter  P22>  The  equa¬ 
tions  (23)  may  be  written  as 

—21  P11  —  "  &i  £)n+1  »  for  n  i  0  •  (26) 

As  Ptl^  -  n]  -  P21  (P^-P^)  e  -  (j^  e)n  (1  -  S)  “  0-_Y2)n  Y2  * 

(I-P22)11  p22  »  this  completes  this  proof. 

In  the  present  case,  from  the  equations  (20-22)  and  (26),  it  results  that 
the  process  of  platooned  events  is  a  renewal  process  if  and  only  if 

f  Fn  e  -  (1  -  (f_(I-F) -1  e)'1)"  ,  for  n>0  , 

where  1  +  f.  (I-F)”*  e  is  the  expected  number  of  events  in  a  platoon. 

4.3  The  Interrupted  Poisson  Process 

This  process  is  used  in  models  for  telephone  engineering  (Heffes  [1]). 

We  consider  a  process  in  a  random  environment,  with  two  alternating  environ¬ 
ment  states.  Both  states  have  exponential  duration,  with  parameters  0^  and 
a 2  respectively.  While  the  process  is  in  the  first  environment  state  (on-state). 


an  independent  Poisson  process  of  rate  X  is  turned  on.  When  the  environ¬ 
ment  is  in  the  second  state  (off-state),  no  arrivals  can  occur.  Neuts  and 
Chakravarthy  [6]  have  shown  that  the  interrupted  Poisson  process  is  a  special 
case  of  the  platooned  events  process,  and  that  the  number  of  events  in  a 
platoon  is  geometric,  therefore,  the  stationary  interrupted  Poisson  process  is 
a  renewal  process.  This  was  already  shown  by  Kuczura  [3]  by  different  methods. 

In  fact,  it  appears  that  the  interrupted  Poisson  process  is  a  very 
special  case  of  the  type  of  processes  analysed  in  the  present  paper.  From 
[6],  one  observes  that  the  process  can  be  described  by  two  states  and  two 
PH-distributions,  the  matrix  P  and  the  PH-distributions  are  as  follows. 


_ X_ 

X+c^ 

al 

X+a^ 

P  = 

_ X_ 

al 

f 

-  (1) 

*  T1 

■  (-X  -  a1)  , 

-X-°l 

X+a^ 

0 

T2  - 

0 

- 

-X-a1 

X+o^ 

0 

a1a2(X+a1)  1 

~a2 

(27) 


The  first  state  of  the  Markov  chain  P  corresponds  to  the  following  event 
{the  interrupted  Poisson  process  is  in  the  on-state,  and  an  arrival  will 
occur  before  the  end  of  the  on-state).  The  second  state  corresponds  to  the 
following  composite  event  {the  interrupted  Poisson  process  is  in  the  on- 
state,  no  arrivals  will  occur  before  the  next  off-state  or_  the  process  is  in 
the  off-state,  or  the  process  has  returned  to  the  on-state  and  an  arrival  will 
occur  before  the  next  off-state).  From  the  structure  (27)  of  P,  it  is 
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obvious  Chat  the  interrupted  Poisson  process  is  a  renewal  process. 
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